Hugging Face
Quick Start Guide
Note: AI_MODEL should stay default unless there is a folder in prompts specific to the model that you're using. You can also create one and add your own prompts.
Update your agent settings
- Set
AI_PROVIDERtohuggingface. - Set
HUGGINGFACE_API_KEYto your Hugging Face API key. - Set
HUGGINGFACE_STABLE_DIFFUSION_MODELto the name of the model you want to use. Default isrunwayml/stable-diffusion-v1-5. - Set
HUGGINGFACE_STABLE_DIFFUSION_API_URLto the API URL of the model you want to use. Default ishttps://api-inference.huggingface.co/models/runwayml/stable-diffusion-v1-5. - Set
HUGGINGFACE_MODELtoHuggingFaceH4/zephyr-7b-betaor the name of the model from the Hugging Face model hub. - Set
HUGGINGFACE_STOP_TOKENto the token that you want to use to stop the model from generating more text. Default is ` - Set
HUGGINGFACE_TEMPERATUREto a value between 0 and 1. The higher the value, the more creative the output. - Set
HUGGINGFACE_MAX_TOKENSto the maximum number of input tokens. - Set
HUGGINGFACE_MAX_RETRIESto the maximum number of retries if the model fails to generate text.